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REMARKS/ARGUMENTS 

The Office action mailed December 31, 2007, the specification was objected to, certain 
claims were objected to, claims 1, 2, 10, 1 1 were rejected under 35 U.S.C. § 1 12, as are claims 5 
and 14, and the Office action indicates that Applicant's arguments filed on 10/05/2007 with 
respect to claims 1-18 have been fully considered but are not persuasive. 

Claims 1, 3, 7, 10, 12, and 16 are now amended, and claims 2, 4-5, 11, 13-14, and 19 are 
cancelled. Accordingly, claims 1, 3, 6-10, 12, and 15-18 remain in the appUcation. 

The specification has also been amended. Particularly, the prior lengthy Summary of the 
Invention section has been placed into the Detailed Description, and a new Summary of the 
Invention has been added. The new Summary of the Invention section adds no new matter, and 
tracks the language of claim 1. 

In this regard, the Office action on p. 2 indicates that the amended specification does not 
fully comply with 37 C.F.R. § 1.77(b). 37 C.F.R. § 1.77(b) indicates that the specification should 
include various sections in order [Ust of sections omitted]. As an initial matter, it appears that 37 
C.F.R. § 1.77(b) is permissive, using the term "should". In addition, it is noted that many of the 
sections do not apply to the present application. In any event, it is believed that the amended 
specification complies with 37 C.F.R. § 1.77(b). 

The disclosure is also objected to under 37 C.F.R. §1.71. It is not clear under what 
section of 37 C.F.R. § 1.71 the disclosure is objected to, and it is beUeved that the disclosure 
compUes with 37 C.F.R. § 1.71. Nevertheless, the Office action points to several items as not 
being understood. For example, the Office action points to p. 1, lines 29-30 of the specification 
dated February 25, 2002 as being not understood. As indicated in the Office action, this section 
states "when no queue is transmit units or packets using the bandwidth with the guaranteeing 
process." It is believed that this terminology is clear on its face, namely that time or period when 
no queues transmit units or packets using the bandwidth guaranteeing process. Similarly, the 
other sections pointed to in the Office action, this section also appears clear, notwithstanding that 
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they may require careful reading. In addition, these sections have been moved to the Detailed 
Description section, as appears to have been requested by the Office action on p. 7. 

hi addition, it is respectfully noted that certain amendments have been made to the 
claims, the amendments being in compUance with the specification as originally filed, and which 
substantially provide for the same or subset of the same information originally provided in the 
specification, with perhaps wording that provides more clarity to the Examiner. 

Claims 4, 13, and 14 were objected to for informalities. These claims have been 
cancelled. Claims 1,2, 10 and 1 1 are rejected under 35 U.S.C. § 1 12, section paragraph, as being 
indefinite. Claims 2 and 1 1 have been cancelled, and claims 1 and 10 have been amended. 

For claim 1 the Office action indicates that "when no queues transmit units or packets 
using the bandwidth guaranteeing process" is unclear as it is not clear which group of queues is 
being referred to. Claim 1 has been amended to state "for the queues not using the bandwidth 
guaranteeing process, when no queues using the bandwidth guaranteeing process transmit 
packets". It is believed that the current formulation made be of assistance to the Examiner, 
although it is not believed that the current formulation differs fi-om the prior formulation of claim 

1. A similar change has been made to claim 10. In addition, other changes have been made to 
resolve the other issues indicated by the Examiner. 

Similarly, changes and comments apply to claim 10. 

Claim 1 is also rejected under 35 U.S.C. § 1 12 for reciting "that queue" in line 1 8. Claims 

2, 10 and 1 1 are rejected on the same basis. A careful review of these claims, however, indicates 
that the phrase "that queue" does not appear in the respective claims. 

Claims 5 and 14 were rejected also under 36 U.S.C. § 112. Claims 5 and 14 have been 
cancelled. 

The claims were previously rejected as obvious in view of various items of prior art, 
including U.S. Patent No. 6,895,012 to Amou et al. The Office action indicates that "when no 
queues transmit units or packets using the band of guaranteeing process" as when all the priority 
queues of the priority queue class are empty. Claims 1 and 10, however, specify, for the queues 
not using the bandwidth guaranteeing process, when no queues using the bandwidth 
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guaranteeing process transmit packets. It is believed that this change is in accordance with what 
appears to be a suggestion by the Examiner on p. 14 of the Office action. 

Moreover, Amou et al. at col. 7, lines 47-61 discusses the priority queues of the priority 
queue class being empty, and not the bandwidth guaranteed queues. 

Accordingly, the application is beUeved in condition for allowance and allowance is 
respectfully requested. 



Respectfully submitted, 
CHRISTIE, PARKER & HALE, LLP 




Daniel M. Cavanagh 
Reg. No. 41,661 
626/795-9900 
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A METHOD AND APPARATUS FOR SCHEDULING DATA ON A MEDIUM 
BACKGROUND OF THE INVENTION 

The present invention relates to a method and an {q)paratus/system for implementing 

^ weighted fair queuing and in particular weighted byte fairness in an Ethernet networic. 

A weighted fair queuing in an ATM network may be seen fixjm US-A-6,018,527 which 
determines which queue is the next to transmit by detennining vsiiich queue has the earliest starting 
time. When transmitting an ATM packet ftom a queue, the starting time of that queue is updated by 
adding thereto a constant value. 

Quality of Service is also described in EP-A-1,104,219, US-A-6,246,256, 5,917,822, 
6,134,217, and WO-A-98/35465. These references describe the use of eiflier bandwidth 
guaranteeing processes or processes where a given bandwidth is split between a number of users. 
Also, a number of the references relate only to fixed-size cells and therefore do not take into 
account the problem of fair treatment of queues sending cells or packets of differing sizes. 
SUMMARY OF THE INVENTION 

jj A method of transmitting information packets fimm a plurahty of queues into a single 

transmission medium, wherein the packets m ay have different sizes, the mefliod comprising: a 
bandwidth guaranteeing process transferring packets fiom one or more queues to the transmission 
medium in a manner so that each of those queues can obtain at least a predetermined bandwidth. 
and a queuing process comprising the steps of: 1. assigning a priority to each of the queues not 
using the bandwidth guaranteei ng process: 2 . defining, fo r each of the queues not using the 

20 bandwidth guaranteeing process, a vari able, and 3. for the queues not using the bandwidth 
guaranteeing process, when no queues using t he bandwidth guaranteeing process transmit packets: 
determining a first queue having a variable with a value fulfilling a predetermined criterion, 
transmitting a packet fi-om the first queue to the transmission medium, and determining a new value 
for the variable of the first queue, the new value based on a mathematical operation using a 
previous value for the variable at a point in time prior to transmission of the packet and a factor 

25 scaling the priority of the first queue multiplied with a fiictor relating to a size of the packet 
transmitted &om the first queue, tiie new value not fiilfilling flie predetermined criterion. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

In the following, a prefer red anbodiment of the invention is described with reference to the 

drawing, wherein 

^ Fig. 1 illustrates a block diaffam of a system embodying the invention, 

Fig. 2 is a flow diagam of an outer loop performing part of the monitoring. 

Fig. 3 is a flow diagram of an inner loop relating to a single queue. 

Fig. 4 illustrates the fimctioti and timinp of the WFO, 

Figs. 5-8 illustrate dififerent examples of the operation of the invention. 
DETAILED DESCRIPTION 

In a first aspect, the invention relates to a method of transmitting information units or 
packets fiwrn a plurality of queues into a single transmission medium, wherein the units or packets 
may have different sizes, the method coniprising: 

- a bandwidth guaraoteemg process transferring units or packets from one or more queues 
of a first group of the queues to the transmission medium in a manner so that 
J ^ each of those queues can obtain at least a predetermined bandwidth, and 

a queuing process comprising the steps of : 

1. assigning a priority or quality to each of the queues in a second group of queues, 

2. defining, for each of the queues in the second group, a variable, and 

3. when no queues transmit units or packets using the bandwidth guaranteeing process; 

[[□]] determining a queue in the second group having a variable with a value 
2Q fulfilling a predeteimined criterion, 

[[□]] transmitting a packet or unit finm that queue to the transmission medium, and 
[[□]] determining a new value for the variable of the queue, the new value relating 
to a mathematical operation using a previous value for the variable at a point in time prior to 
transmission of the packet or unit and a factor scaling withAelating to the priority or quality of the 
queue multiplied with a &ctor relating to a size of the packet or unit transmitted &om the queue 
25 and/or a period of time used fin: transmitting the packet or unit, where the mathematical operation 
brings the new value to, compared to the previous value, not fiilfil the predetermined criterion. 



-2- 



1 



57035m6S 



MARKEP-UP VERSION 



fii this context, a priority or quality of a queue will be a value, which, relative to those of the 
other queues, defines a ranking vis-a-vis importance of the queues. Naturally, several queues may 
have tihe same priority or quality. 
5 In ae present context, the fector scaling with or relating to the priority or quality assigned 

may be either smaller or higher the higher the iniqiartance of the queue or the data held thereby. The 
mathematical operation will be able to take into account any scaling or relation in order to obtain 
the correct relative change between flie value of the transmitting queue and those of the other 
queues. 

The overall effect of the mathematical operation is to bring the value of the transmitting 
queue to not fulfil, compared to the previous value, the criterion. In this manner, other queues may 
get to transmit their packets. An alternative would, naturally, be to perform another mathematical 
operation on all the other queues than the transmitting one in order to bring about the same relative 
change. 

In relation to the determination of the new value, it is important to note the overall fimction 
being that the method ensures that longer data packets/units have the effect of providing larger 
values/ofifeets and thus a longer delay before tiiat queue is allowed to tiansmit again. Also, flie 
lower the importance (the higher the priority or quality in tiie present context), the longer the delay. 

The factor scaling with or relating to the priority or quality of the queue (or the data therein) 
may simply be assigned thereto — or may be derived therefrom by a mathematical operation. Thus, 
"scaling" will mean any interrelationship — but is preferably the same for all queues. Scaling may 
2Q be the lifting of a value to any potency, the multiplication with any positive number, or a 
combination tiiereof, etc. Alternatively, the higher a priority/quality, the higher a ftctor may simply 
be provided — or the lower a factor maybe provided. 

Naturally, the mathematics or fimctioning of the invention may be inversed without any 
degradation of the functioning thereof Also, preferably all values of the queues are regularly 
reduced/corrected, such as with the same amount, in order to avoid buffer overflow. This has no 
25 impact on the flmctionality or ranking/timiag of the queues. 
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Units or packets having varying sizes are seai in e.g. the Internet Protocol, such as along 
the Ethernet standard, the standards of IEEE 802.1, 802.3, Apple Talk, Token Ring, Frame Relay, 
and FDDI. 

Naturally, the transmission medium may be a single medium able t» transmit only a single 
packet or unit at the time or it may be an aggregated or trunk medium, which is able to actually 
transport a number of packets or units in parallel. The overall method of the invention is equally 
well suited for handling these situations. 

Also, naturally, the bandwidth guaranteeing process can only transmit data packets or units 
if one or more of the queues of the first group have data to transmit. The same holds true for the 
queues in the second group and for the queuing process, hi this context it should be noted that a 
queue may be a member of both the first and second groups. This merely indicates that the queue 
both wishes to have a minimum bandwidth at its disposal — and to be able to burst out more data if 
required. 

A well-known bandwidth guaranteemg process is the Leaky Bucket process where the 
bandwidth use of each queue is monitored and controlled. Another such process is the Token 
Bucket process. 

The present fair queuing process is able to adq)t itself to variations in available bandwidth 
— that is both variations in the bandwidth use of the bandwidth guaranteeing process and the 
bandwidth available on the medium. The overall advantage of the values instead of actual time 
delays is that when using the values, the method becomes independent of changes to the available 
bandwidth. 

Thus, preferably the &ir queuing process will define an order according to which packets or 
units are transmitted from the queues. No absolute timing is preferred in that that requires total 
knowledge about the bandwidth available in the fixture. 

The hierarchy between the bandwidth guaranteeing process and the &ir queuing preferably 
is so that all queues of the first groiQ) are able to use fteir predetermined bandwidths. If bandwidth 
is available, such as when the sum of all predetermined bandwidths does not add up to 100% of the 
bandwidth on the medium, or if one or more of the bandwidth guaranteeing processes does not use 
its predetermined bandwidth, the "excess" bandwidth is controlled by the &ir queuing process. 
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In the present context, the fector relatiiig to the size of a transmitted packet or the time used 
for transmitting it may be determined in a number of ways. One way being using the actual size of 
the packet. Another maimer is especially suitable when a number of bits/bytes of the packet are 
^ transmitted or handled at the same time, whereby the number of such parts to be handled may be 
used. This number is not necessarily fully related to the actual size of Ifae packet in that the last part 
to be handled may not be full. A third manner of detennining the factor is one relating to the time 
used for transmitting the packet. If the packet is transmitted at a constant rate, this time may relate 
to the size of the packet — or to flie number of parts transmitted. However, bandwidths may vary 
so that these fictors may not be fully interrelated. The important factor here is to take the varying 

10 

sizes of packets into account in order to bring about more fairness when enabling flie transmission 
of packets of differing sizes. 

Also, the criterion to be Mfilled will relate to the remaining factors and mathematical 
operations performed. This criterion will normally be the selection of the largest or lowest of the 
values. The criterion may vary if there wnq)-around of buffers is possible so that it is no longer 
J J desirable simply to look for the largest or lowest value. This will be obvious to the skilled person. 

The overall philosophy of the &ir queueing of the invention is flie &ct that when a given 
queue has been selected for transmission, the amount with which its new value will be brought 
"away" from the previous value fiilfilling the criterion will be larger the larger a packet was 
transmitted. This does not mean that that queue cannot fulfil the criterion taking into account the 
values of the other queues. Naturally, instead of actually altering the value of the queue, the values 
20 of the other queues may be altered as well or instead. The relative change is flie important factor. 

Step 3 coidd be performed repeatedly so that it is mterrupted by the bandwidth guaranteeing 
process. 

In the preferred embodiment, step 3 comprises: when no queues transmit (or wish to) units 
or packets using the bandwidth guaranteeing process: 

[[□]] determining a queue in the second group having a variable with a smallest 

25 value, 

[[□]] transmitting a packet or unit fiom that queue to the transmission medium, and 
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[[□]] determining a new value for the variable of the queue, the new value relating 
to a value for the variable at a point in time prior to transmission of the packet or unit plus a factor 
scaling with/relating to the priority or quality of the queue multiplied with a factor relating to a size 
5 of flie packet or unit transmitted from the queue and/or a period of time used for transmitting the 
packet or unit. 

Naturally, this operation may be reversed so that the largest value is sought for and so that 
the addition is replaced with a subtraction (or an addition to the other values). 

Preferably, the step of transmitting the data packet or unit comprises transmitting the packet 
or unit in accordance with a periodic timing signal and wherein the step of determining the new 
value for the queue comprises, during transmission and for each period of the timing signal, 
providing a new value for the variable by performing the predetermined mathematical operation on 
a previous variable value and a fector scaling wifli the priority or quality of the queue (preferably 
the priority or quality itself). A predetermined amount of data may be transmitted in or at each 
period of the timing signal, 

J J Preferably, step 3 is adapted to be stopped, with a first set of values, when a packet or unit 

(in the fair queuing process) has been transmitted and a queue from the first group of queues 
wishes to transmit a packet or unit and to be resumed with a second set of values each 
corresponding to a value of the first set of values, when none of the queues of the first group wishes 
to transmit a packet or unit. 

In addition or alternatively, step 3 could comprise the step of altaing the variables of the 

2Q queues oftfae second group in accordance with a predetermined relationship. 

This correspondence/relationship may be the identical values or all values subtracted or 
added a given value (in order to avoid buffer overAmderflow). Also, depending on the 
mathematical operations used, division or multiplication with predetermined values may be used. 
Preferably, a relation — or at least the order in the view of the criterion — is maintained by this 
altering. 

25 An interesting embodiment fiirther comprises the step of determining a bandwidtii used for 

at least one of the queues. 

This knowledge may be used for a number of tilings, such as: 
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[[-]] where the embodiment further comprises the step of altering, on the basis of the 
bandwidth used by a queue, a parameter of the bandwidth guaranteeing process for the queue 
and/or the priority/scaling of the step of determining a new value for the queue and/or 
^ [[-]] where the embodiment fiirther comprises Has step of providing information to an 

operator of the bandwidth used. 

In the first situation, the share of the feir queuing bandwidth assigned may be increased or 
decreased depending on the overall historic bandwidth used — such as by altering the 
priority/quality, the values, the fector's scaling or the like. An alternative would be to alter values 
used in the guaranteed bandwidth process. If this process was a leaky bucket process, this might be 
to alter the drop rate ibweof. 

The second situation is well suited for billing on the basis of the bandwidth used. 

Computational simplicity is achieved when the step of defining the variable comprises 
defining an integer value relating to a priority or quality of each queue. 

A second aspect of the invention relates to an apparatus for transmitting information units 
or packets torn a plurality of queues into a single transmission medium, wherein the units or 
packets may have different sizes, the eppsntas comprising: 

[[-]] bandwidth guaranteeing means for transferring units or packets fiom one or more 
queues of a first group of the queues to the transmission medium in a manner so that each of those 
queues can obtain at least a predetermined bandwidth, and 

[[-]] queuing means comprising: 
20 1- means for assigning a priority or quality to each of the queues in a second 

group of queues, 

2. means for defining, for each of the queues in the second group, a variable, 

and 

3. means for, when no queues transmit units or packets using the bandwidth 
guaranteeing process: 

25 [[□]] determining a queue in the second group (having data) having a 

variable with a value fulfilling a predetermined criterion. 
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[[□]] transmittiiig a packet or unit from that queue to the transmission 

[[□]] determining a new value for the variable of the queue, the new value 
relating to a mathematical operation using a previous value for the variable at a point in time prior 
to transmission of the packet or unit and a &ctor scaling with/relating to die priority or quality of 
the queue multiplied with a factor relating to a size of the packet or unit transmitted fiom the queue 
and/or a period of time used for transmitting flie packet or unit, where the mathematical operation 
brings the new value to, compared to the previous value, not fulfil the predetermined criterion. 

Step 3 could be performed continuously so that it is interrupted by the bandwidth 
guaranteeing process and otherwise overlooks any transmissions in the "excess" bandwidth. 

In the preferred embodiment, the means 3 comprise means for: when no queues transmit 
units or packets using the bandwidth guaranteeing process: 

[[□]] determining a queue in the second group having a variable with a 

smallest value, 

[[□]] transmitting a packet or unit fiom that queue to the transmission 

medium, and 

[[□]] detemiining a new value for the variable of the queue, the new value 
relating to a value for the variable at a point in time prior to transmission of the packet or unit plus 
a factor scaling with/relating to the priority or quality of the queue multiplied with a factor relating 
to a size of the packet or unit transmitted fiom the queue and/or a period of time used for 
transmitting the packet or unit. 

Again, the means for transmitting the data packet or unit may comprise means for 
transmitting the packrt or unit in accordance with a periodic timing signal and wherein the means 
for determining the new value for the queue comprise means for, during transmission and for each 
period of the timing signal, providing a new value for the variable by performing the predetermined 
mathematical operation on a previous variable value and a factor scaling with the priority or quality 
of the queue. 

Also, preferably the means 3 are adapted to be stopped, witti a first set of values, when a 
packet or unit has been transmitted and a queue from the first group of queues wishes to transmit a 
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packet or unit and to be resumed with a second set of variables each corresponding to a value of the 
first set, when none of the queues of the of the first group wishes to transmit a packet or unit. 

And, the means 3 could be adq>ted to alter the variables of the queues of the second group 
^ in accordance with a predetermined relationship. 

Again, the apparatus could comprise means for determining a bandwidth used for at least 
one of the queues so that it could comprise means for altering, on the basis of the bandwidth used 
by a queue, a parameter of the bandwidth guaranteeing means for the queue and/or the 
priority/scaling of the means for determining a new value for the queue and/or means for providing 
information to an operator of the bandwidth used. 

Also, the means for defining the variable could comprise means for defining an integer 
value relating to a priority or quality of each queue. 

The preferred embodiment of the invention is embodied on a single ASIC fiirther 
comprising: 

[[-]] a number of input ports either connected directly to one or more data 
packet/unit providers, such as one or more networks, or to the individual queues if these are not 
embodied in fiie ASIC, and 

[[-]] at least one output to the medium. 
In this situation, all logical circuits providing the above fimctionality would be on the ASIC. 
Naturally, the invention may alternatively be embodied in a number of interconnected chips, 
computers, ASICs or the like — and a number of storage devices may be provided, such as RAM, 
20 ROM, PROM, EPROM, EEPROM, hard discs, floppy discs, optical discs, or the like for holding 
values, data units/packets, queues, and any additional data. In fact, preferably all queues are 
embodies as linked Usts in the same RAM. Finally, any inputting means, such as a keyboard, may 
be provided for providing the quaUty/priority data, the predetermined bandwidths etc. This 
information may also be provided via any of the input ports. 
Bri e f D e ooription of tho Drawings 
25 In th e following, a profoirod ombodim e nt of th e inv e ntion ie d e eorib e d with r e f e r e noo to tho 

Fig. 1 illuatmtoo a block diagram of a oynt e m e mbodying th e inv e ntion. 
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Fig.2iBaflo\ 
Fig.3ioaflOT 
Fie- ' 1 iUuotnil 
FigB. 5 8 illuBi 




diagram of an innw loop rolaling to a t 
I the fiinctioii and timmg of th e WFQ, 




of the: 



Fig. 1 illustrates the overall structure of the preferred embodiment where each of eight 
Hybrid Fair Shapers, one of which is illustrated at 10, and each monitoring a queue (one of which 
is illustrated at 11), communicate via communication lines 12 with a controlling device 14. The 
device 14 receives packets fi»m the queues (11) in a controlled manner and transmits these on a 
transmission medium 16. The bandwidth transmitted by each queue 11 is monitored by a 
bandwidth monitor 18 (of which one is provided for each queue). 

The overall bandwidth transmitted on the medium 16 is monitored by a link rate shaper 17 
which feeds back information on available bandwidth to the device 14 so that the bandwidth of the 
medium 16 may always be used. The bandwidfli on the medium 16 may vary due to a number of 
factors, such as congestion at a receivmg networking element also connected to the medium 16. 

Each shaper 10 receives a queue-not-empty signal from its pertaining queue 11 in each 
cycle as described below. Each shaper 10 provides two types of signals (BW_enable and 
WFQ_enable) to the device 14. 

The BW_enable signal signals to the device 14 that, according to a Leaky Bucket process, 
the pertaining queue wishes to transmit a packet in order to obtain its guaranteed bandwidth on the 
medium 16. Any number of the queues can have BW_enable signals activated at the same time. 

A Leaky Bucket may be realized as a number reduced by a given drop rate each clock cycle 
and increased by a predetermined amount each clock cycle a data packet is transmitted from the 
pertaining queue. Also, the Leaky Bucket has a threshold above which the queue is not allowed to 
transmit a data packet. However, over time the number will decrease until it reaches the threshold 
and the BW_enable signal is set. Transmitting a data packet vrill increase the bucket level (the 
number), and if the packet transmitted is large enough, the bucket level may be higher than the 
threshold again. If not, the BW_enable signal will remain in order for the queue to again transmit a 
packet. 
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The WFCLenable signal signals to the device 14 that the pertaining queue is the next queue 
to send a packet when the Leaky Bucket processes do not take up the full bandwidth of the medium 
16. Only one queue can have a WFQ_enable signal at the time. 
5 The device 14, receiving the BW_enable and WFQ_enable signals &om the shaper, will 

determine which device (that is, which queue) is to transmit data when a piesoit data packet has 
been transmitted. This determination is performed after the priority of BW 0, BW 1, .. BW 7, WFQ 
0, WFQ 1, ... WFQ 7. Thus, data is always transmitted under the guaranteed bandwidth if the 
schedulers 10 have such data to transmit. Otherwise, data (if present) is transmitted fiom the 
Weighted Fair Queueing process. Please note that the priority between the WFQ queues is not 
relevant in that only one thereof can have the WFQ_enable signal on. 

In return, each shaper receives a BW active and a WFQ_active signal ftom the device 14. 
These signals inform the shaper of when the pertaining queue is transmitting under the bandwidth 
guaranteeing process or the weighted fair queuing process (or not at all). 

The actual process taking place in each of the sheers 10 is illustrated on Figs. 2-4 and 
J J comprises an outer loop illustrated on Fig. 2, the outer loop scanning all queues (including itself) 
during one time slot (11 clock cycles), and an inner loop illustrated on Fig. 3, the inner loop 
relating to a single queue and being perfijnned during a single clock cycle. The frequency of the 
system being preferably 166 MHz. Fig. 4 illustrates the timing and fimction of the Weighted Fair 
Queuing. 

The outer loop scans all individual queues and eventually results in a data packet being 
20 transferred from a queue 1 1 to the medium 16. 

The outer loop comprises the steps of: 
ScanAllQueues 

Pr^aie next loop 213 

Invalidate WFQ candidate register 
InvaUdate normalizing of&et minimizer register 
25 for (0. max_queue) 21 5 

ScanSignalQueue(#) 217 
end for 219 
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Analyze scanning result 221 

if (No WFQ candidate already pending) AND 
(WFQ Candidate is operationally enabled — member of the second 



Enable WFQ « 
Set noimalizer offset to mm value fiom scanning 

end if 

*): or maybe alternatively the number of bits/bytes transmitted 
The inner loop is as follows: 

ScanSingleQueue(#) 

Monitor scheduler BW activity 313 

// fiicrease bucket level if transmission is active 
if (transmission active) then 

bucket level := bucket level + 1 .0 •) 

end if 

bucket level := bucket level - configured drop rate 
// Limit bucket level at zero to avoid negative level 
if (bucket level negative) then bucket level := 0 
Monitor scheduler WFQ activity 3 1 5 

// Rearm departure timer if transmission is active 
if (Scheduler is transmitting in a WFQ slot) then 
// Time slot utilized for this queue 
Dq>arture time delay ~ current dep. delay + weight 
end if 

end if 

Enable BW candidates 317 

if (data in queue) AND (bucket level below threshold) then 
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Enable BW indication line // *) 

Enable WFQ candidates 319 

// Apply noimalizer to avoid departure timer overflow 
Departure time delay := Departure time delay - Normalizer 



if (Departure time delay negative) then 
Departure time delay := 0 

end if 

//Look for a WFQ candidate (or a better one if we already 



if (WFQ mode enabled) AND (data in queue) AND 
(Departure time delay < normalizing offeet minimizer 



offset 



have one) 



register) 



15 



then 



izer register := Departure 



timei 



I delay 



WFQ candidate := <Current queue> 



end if 



20 



*): Please note that most of the variables in the inner loop exist in one copy per queue. 



Also, please note that all queues may have an active BW tx indication line at the same time, 
while only one WFQ tx indication line can be active at any time. (Remember the scheduler priority: 
BWO..BWn..WFQO..WFQn). 



25 



In each time slot of the process, each of the queues is scanned as illustrated in Fig. 3 where 
the Leaky Bucket level is adjusted step 313 according to the drop rate of the bucket and taking into 
account whether the device 14 is transmitting a data packet (in accordance with the Leaky Bucket 
process) from that actual queue. The resulting bucket level or number is con^aied to the bucket 
threshold and the BW_enable signal set accordingly 319 
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The Weighted Fair Queuing (WFQ) is handled by steps 315 and 319 and works as follows; 
The WFQ divides bandwidth not used by queues reserving bandwidth via the Leaky Bucket 
processes between queues wishing to transmit over the WFQ channel. 
^ Each queue wishing to transmit over the WFQ channel is assigned a "weight" which is a 

number inversely related to a priority, quality level, or desired fiaction of excess bandwidth to be 
made available for the given queue. 

For each queue wishing to transmit over the WFQ channel, a Departure time delay is 
calculated. The Departure time delays of the queues define which of the queues is to be the next to 
use the WFQ channel. These delays are initially assigned a value corresponding to the weight of 
the queue and when a queue transmits a WFQ data packet ova: the medium 16, the pertaining delay 
is added to the weight each time slot where the queue is transmitting the data packet 315. An 
alternative process would be one where the weight is added each time a predetermined number of 
bits or bytes has been transmitted fixnn the queue. 

In this manner, the transmitting queue obtains a new delay with a higher number. After ttiat, 
^ ^ it is to be determined which queue is to transmit the next time — the queue now having the lowest 
delay 319. 

Thus, it is clear that the values of the Weighted Fair Queuing process (weights and 
Departure time delays) ate not altered when guaranteed bandwidth data is transmitted. One might 
say that time has been stopped when guaranteed bandwidth data is transmitted. In this manner, the 
WFQ process is simply restarted after a BW process has ended (and when no other BW data are 

20 waiting). However, in order to avoid timer overflow, the delay values may be reduced by a &ctor 
Q>referably by the same value - Nonnalizer o£&et). Naturally, this normalization or reduction may 
be performed in any maimer desired (subtraction or division). However, subtraction will ensure the 
same order of the queues and will therefore not interfere with the process. 

Fig. 4 illustrates an example of this WFQ wherein three queues. A, B, and C wish to 
transmit data over the WFQ channel. The queue A has a WFQ weighting — or a configured 

25 departure time — of 1 whereas those of queues B and C are 2. In practise, this means that A wishes 
to transmit twice the amount of data, compared to queues B and C, over the WFQ channel. 
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Initially, the delays of all three queues are assigned to zero. Subsequently, it is determined 
which queue is the first to transmit a data packet. This queue is fliat with the smallest delay, and if 
more queues have the same delay, that found first taken in a given order. In this situation, queue A 
5 is the first to transmit data. 

Queue A is now allowed to transmit a data packet over the medium 16. For each time slot 
fliis transmission takes, the current delay of A is added to the configured departure time of A. Thus, 
when A has transmitted a data packet over a total of three time slots, the delay of A will be 3. 

Subsequently, the next queue to transmit a data packet will be determined. There are now 
two candidates, B and C and the first of these — B is selected. B now tninsmits a data packet 
taking two time slots to transmit. The resulting delay of B will subsequently be 4. 

AAer that, C will be allowed to transmit a data packet. If C transmits a packet taking only 
one time slot to transmit, its final delay will be 2. Then, even though C was the last queue to 
transmit, it transmitted a so small packet that it still has the smallest delay. Therefore, C will be the 
next to transmit a packet. 

J J Preferably, at the end of each time slot, all delays are reduced with the same amount so that 

the smallest delay(s) is/are zero. This is in order to avoid the risk of buffer overflow when these 
numbers become too higji. 

Now, the device 14, what determining torn which queue a next data packet is to be 
transferred to the medium 16, firstly checks whether a queue wishes to send a LB packet — that is, 
if a queue wishes to use bandwidth reserved to it. If this is not the case, the WFQ channel is 
2Q available, and the next queue is chosen to be that having the smallest delay. If the LB channel is 
used, the WFQ channel — and all delays fliereof — will remain unchanged. 

It is evident that A will be able to transmit twice as much data as B and C in the WFQ 
channel. Also, it is clear that no queue will be blocked for a longer period of time. If a queue 
transmits a large data packet, it vinll take that much longer time before it is allowed to transmit 
again. 

25 Also, it is evident that data is only transmitted over the WFQ channel when the device 14 

determines that there is available bandwidth on the medium 16. 
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In addition, it is interesting to note that the same queue may, in feet, transmit packets 
enabled both by a Leaky Bucket process and a WFQ process. 

Figs. S-8 illustrate different tests of flie present embodiment combining the Weighted Fair 
^ Queuing (WFQ) and a Leaky Bucket (LB) process. 

In Fig. 5, 4 queues (#0, #1, #2, and #3) are defined each having a Leaky Bucket 
contribution with a transmit threshold (xmit tresh) a drop rate (drop_rate — a drop rate of 0 
indicating no LB contribution), a Weighted Fair Queue fraction (wfq_slot_dist scaling inversely 
with the fraction of total amount of transmission opportunities — a fraction of 0 indicating no 
WFQ contributian) as well as traffic generator flow data such as packet size (size), number of 

10 

packets added to each queue (by a traffic goierator) in one burst (count), and a period of time to 
lapse between the traffic generator adds packets to the queue). 

Each queue #0, #1, #2, and #3 transmits packets of a size taking 1 time slot to transmit, #0 
and #3 wishing to transmit (one packet at the time) at time 0 and #1 and #2 wishing to transmit 250 
packets with a delay of 500, and the queues having WFQ fractions 0, 4, 8, and 4, respectively (0 
^ ^ meaning a disabled WFQ contribution). 
The actual data are as follows: 
•SHAPER CONHGLIRATION 
••//### QUEUE 0### 

•xmit_tresh = 0.75; 'drop.rate = 0.5;wfi]_slot_dist = 0; 

"//mm QUEUE 1 ### 

20 •xmit_tresh = 0; •dropjrate = 0; •wfq_slot_dist = 4; 
"//### QUEUE 2 ### 

•xmit tresh = 0; = 0; •drop_rate = 0; •wfq_slot_dist = 8; 
••//### QUEUE 3 ### 

•xmit_tresh = 0;'drop_rate = 0;*wfq_slot_dist = 4; 

25 • TRAFFIC GENERATOR FLOWS 

R26;Queue no/ Size /Count / Delay 

#0110 
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#1 1 250 500 
#2 1 250 500 
#3110 

5 

Thus, #1, having a fiaction of 0, is a Leaky Bucket-only queue having reserved half the 
bandwidth of the transmission medium. From Fig. 5 it is seen that #0 (00) uses/blocks half the 
bandwidth of the transmission medium. 

The remaining bandwidth is divided between #1, #2, and #3 not having Leaky Bucket 
contributions but having different WFQ fractions. From Fig. 5 it is seen that between time=0 and 
time=500, only #3 transmits packets via the WFQ. 

At time=500, both #1 and #2 now contain data packets and therefore wish to transmit. Ehie 
to the differences in WFQ fraction, the 50% of the bandwidth (not reserved by #0) is divided into 
two parts for each of #1 and #3 and one part for #2. 

Due to the different WFQ fractions, #1 and #2 will have transmitted the 250 packets at 
^ ^ different points in time. Each of these queues will delay 500 time slots and then again receive 250 
packets. 

Due to #3 transmitting only one packet at the time and due to it having a WFQ fraction 
equal to that of #1 and twice (the WFQ fraction being inverted in relation to the integer 
representing it) that of #2, it is seen that when #1 and #3, only, transmit, they divide the bandwidth 
equally. When #2 and #3, only, transmit, they divide the bandwidth so that #3 has twice the 
20 bandwidth compared to #2. 

Consequently, the bandwidth remaining from the LB transmission is divided on a Byte 
Fairness basis in accordance with the WFQ fractions of the queues. 

On Fig. 6, all queues have been assigned a WFO fraction of 4. However, #0 is still the only 
LB queue — still blocking 50 of the bandwidth with its LB contribution. However, now #0 also 
takes part m the sharing of the remaining 50% of the bandwidth. 
25 The actual data are: 

•SHAPER CONFIGURATION 
••//### QUEUE 0### 
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•xniit_tresh = 0.25;-drop_rate 
"//### QUEUE 1### 
•xniit_tresh = O;'drop_rate 
••//### QUEUE 2 ### 
•xniit_tresh = 0; •drop_rate 
"//### QUEUE 3 ### 
•xmit_tresh = O;«drop_rate 
•TRAFFIC GENERATOR FLOWS 
R26; 



= 0.5; •wfq_slot_dist = 4; 
= 0; •wfq_slot_dist = 4; 
= 0;«wfq_slot_dist = 4; 
= 0;«wfq_slot_dist = 4; 



#0 



1 



1 



1 



In Fig. 7, the largest difierence is that now two of the queues transmit data packets of a size, 
which takes 24 time slots to transmit. In this situation, transmitting such a data packet will make 
the LB level of #0 drop during transmission. Therefore, xniit_tresh has a value of 25 in order to 
"accommodate" this situation. Otherwise, it is again seen that the overall bandwidth is shared in 
accordance with the different values. 
The data are: 

•SHAPER CONFIGURATION 
••//### QUEUE 0### 

•xmit_tresh = .75;«drop_rate = 0.5; •wfq_slot_dist = 4; 
••//### QUEUE 1 ### 

•xmit_tresh = 0; •drop_rate = 0; •wfq_slot_dist = 4; 

"//#)¥# QUEUE 2 ### 

•xnut_tresh = 0; •drop_rate = 0; ■wfq_8lot_dist = 4; 
••//### QUEUE 3 ### 

•xmit_tresh = 0; •drop_rate = 0; •wfq_slot_dist = 4; 
• TRAFFIC GENERATOR FLOWS 
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R26 :Oueue no / Size / Count /Delay 
#0110 
#1 24 32 8000 
#2 24 32 8000 
#3110 

In Fig. 8, #0 is still the only LB queue still reserving 50% of the bandwidOi but now not 
transmitting until a delay of 2000. Also, delay, size, count and WFQ ftacstions have been altered: 
•SHAPER CONFIGURATION 
••//### QUEUE 0### 

•xmit_tresh = 25»drop_rate = 0.5; •wfq_slot_dist = 16; 
••//### QUEUE 1### 

•xnut_tresh = O;«drop_rate =0; •wfq_slot_dist= 1; 

"//m QUEUE2 ### 

•xmit_tresh = O;*drop_rate = O;*wfq_slot_dist = 1; 



• TRAFFIC GENERATOR FLOWS 

R26;Queue no / Size / Coiint / 

#0 1 16384 2000 
#1 24 32 8000 
20 • #2 24 32 8000 
#3110 

In this situation where all but #3 start with delays, #3 will have the full bandwidth until #0 
starts reserving firstly its 50% of the bandwidth (LB) and additional bandwidth due to its higher 
WFQ fraction (compared to that of #3). 

At time 8000, #1 and #2 start transmitting with higher WFQ fractions whereby the 
25 transmission of #3 is reduced to only 1/133 of the bandwidth (during 64 WFQ steps, #0 will 
transmit 64/16=4 times, # 1 and 2 64 times each and #3 a single time — assuming all packets can 
be sent in one time slot). 



15 



••//### QUEUE 3 ### 
•xmit_tresh = 0;'drop_r8te 



= 0;«wfq_slot_dist = 64; 
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Consequently, it is seen that the invention provides a WFQ scheme, which may be 
combined with e.g. a LB scheme while still providing fair sharing of a bandwidth. Also, it is seen 
that die in^lementation of &e schranes is quite simple and ASIC Mendly in that no multipliets are 
^ required. 

Returning to Fig. 1, operation of the system in order to bill the users of the queues or 10 
simply monitor the bandwidfli use will now be described. 

The bandwidth monitors 18 provide bandwidth use information to a controller 19 which 
enforces the bandwidth policies of the individual queues and controls the processes of the shapers 
10. This may be performed in a number of manners. 

10 

A queue may be allowed to use iq) to a particular upper bandwidth while only a smaller 
bandwidth is guaranteed. The remaining bandwidth is obtained using the weighted fair queuing 
process. However, the bandwidth available will be limited even though the queue has more data to 
send and there is bandwidth on the medium 16. This may be the situation where a fixed amount of 
bandwidth is paid fin- by the user of die queue in question. In this manner, when the upper 

^ J bandwidth has been used, the controller 19 may increase the weighted fair queuing weight of the 
queue in a manner so that only very seldom — or never — is a packet transmitted by that process. 
At a later point in time whoi more bandwidth can be provided to the queue, the weight may be 
reduced again. In this manner, the guaranteed bandwidth is always guaranteed as a minimum and 
only the availability of the "excess bandwidth" is changed. 

The bandwidth monitors may also simply be used for determining the bandwidth used for 

2Q billing a user of a queue. 

Also, the controller 19 may calculate a historic bandwidth use and alter the weighted &ir 
queuing weight if a queue has not used all of its guaranteed (and thereby probably paid for) 
bandwidth. This would be the situation where the queue for a period of time has not had enough 
data to fill up the guaranteed bandwidth. Naturally, the weighted &ir queuing process will take 
advantage of that so that, as long as there is data to transmit, the bandwidth of the medium 16 may 

25 be fiilly used. However, the queue not having had all the guaranteed bandwidth may later on have 
more data and then desire to actually transmit more data than the guaranteed bandwidth. Then, the 
controller 19 may adjust a weighted fair queuing weight of that queue to have that queue take up 



-20- 



1 57035m65 



MARKED-UP VERSION 



more of the non-guaranteed bandwidth so that the queue is able to burst data out and regain lost 
bandwidth. Naturally, this is in addition to the guaranteed bandwidth of the queue. 

The guaranteed bandwidth process of the queue may be able to take into account — to a 
^ certain degree — the fact that too little bandwidth has been used. Using a nonnal leaky bucket 
process, the parameters of the leaky bucket may take that into account. However, a number of 
disadvantages will be seen if the bucket is amended to take into account a larger loss of bandwidth 
over a longer period of time. This, however, is easily determined and calculated by the controller 
19. 

In this context, it should be noted that bandwidth used should be determined over a period 
of time in that only a single queue can send at flie time over a single medium. Naturally, a trunk or 
aggregated medium will be able to send data on parallel media, but the overall bandwidth should 
still be determined over a period of time. Thus, also the controlling of bandwidth and parameters 
for the processes should take that into account. This is obvious to the skilled person and will not be 
further described here. 

RMW IKVl 11463S.l-*-0«aOA)8 5:59 PM 
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